Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Update dependency urllib3 to v2 #44

Merged
merged 1 commit into from
Dec 13, 2023
Merged

Update dependency urllib3 to v2 #44

merged 1 commit into from
Dec 13, 2023

Conversation

renovate[bot]
Copy link
Contributor

@renovate renovate bot commented May 28, 2023

Mend Renovate

This PR contains the following updates:

Package Change Age Adoption Passing Confidence
urllib3 (changelog) ==1.26.18 -> ==2.1.0 age adoption passing confidence

Release Notes

urllib3/urllib3 (urllib3)

v2.1.0

Compare Source

==================

Read the v2 migration guide <https://urllib3.readthedocs.io/en/latest/v2-migration-guide.html>__ for help upgrading to the latest version of urllib3.

Removals

  • Removed support for the deprecated urllib3[secure] extra. (#&#8203;2680 <https://github.com/urllib3/urllib3/issues/2680>__)
  • Removed support for the deprecated SecureTransport TLS implementation. (#&#8203;2681 <https://github.com/urllib3/urllib3/issues/2681>__)
  • Removed support for the end-of-life Python 3.7. (#&#8203;3143 <https://github.com/urllib3/urllib3/issues/3143>__)

Bugfixes

  • Allowed loading CA certificates from memory for proxies. (#&#8203;3065 <https://github.com/urllib3/urllib3/issues/3065>__)
  • Fixed decoding Gzip-encoded responses which specified x-gzip content-encoding. (#&#8203;3174 <https://github.com/urllib3/urllib3/issues/3174>__)

v2.0.7

Compare Source

==================

  • Made body stripped from HTTP requests changing the request method to GET after HTTP 303 "See Other" redirect responses.

v2.0.6

Compare Source

==================

  • Added the Cookie header to the list of headers to strip from requests when redirecting to a different host. As before, different headers can be set via Retry.remove_headers_on_redirect.

v2.0.5

Compare Source

==================

  • Allowed pyOpenSSL third-party module without any deprecation warning. (#&#8203;3126 <https://github.com/urllib3/urllib3/issues/3126>__)
  • Fixed default blocksize of HTTPConnection classes to match high-level classes. Previously was 8KiB, now 16KiB. (#&#8203;3066 <https://github.com/urllib3/urllib3/issues/3066>__)

v2.0.4

Compare Source

==================

  • Added support for union operators to HTTPHeaderDict (#&#8203;2254 <https://github.com/urllib3/urllib3/issues/2254>__)
  • Added BaseHTTPResponse to urllib3.__all__ (#&#8203;3078 <https://github.com/urllib3/urllib3/issues/3078>__)
  • Fixed urllib3.connection.HTTPConnection to raise the http.client.connect audit event to have the same behavior as the standard library HTTP client (#&#8203;2757 <https://github.com/urllib3/urllib3/issues/2757>__)
  • Relied on the standard library for checking hostnames in supported PyPy releases (#&#8203;3087 <https://github.com/urllib3/urllib3/issues/3087>__)

v2.0.3

Compare Source

==================

  • Allowed alternative SSL libraries such as LibreSSL, while still issuing a warning as we cannot help users facing issues with implementations other than OpenSSL. (#&#8203;3020 <https://github.com/urllib3/urllib3/issues/3020>__)
  • Deprecated URLs which don't have an explicit scheme (#&#8203;2950 <https://github.com/urllib3/urllib3/pull/2950>_)
  • Fixed response decoding with Zstandard when compressed data is made of several frames. (#&#8203;3008 <https://github.com/urllib3/urllib3/issues/3008>__)
  • Fixed assert_hostname=False to correctly skip hostname check. (#&#8203;3051 <https://github.com/urllib3/urllib3/issues/3051>__)

v2.0.2

Compare Source

==================

  • Fixed HTTPResponse.stream() to continue yielding bytes if buffered decompressed data
    was still available to be read even if the underlying socket is closed. This prevents
    a compressed response from being truncated. (#&#8203;3009 <https://github.com/urllib3/urllib3/issues/3009>__)

v2.0.1

Compare Source

==================

  • Fixed a socket leak when fingerprint or hostname verifications fail. (#&#8203;2991 <https://github.com/urllib3/urllib3/issues/2991>__)
  • Fixed an error when HTTPResponse.read(0) was the first read call or when the internal response body buffer was otherwise empty. (#&#8203;2998 <https://github.com/urllib3/urllib3/issues/2998>__)

v2.0.0

Compare Source

==================

Read the v2.0 migration guide <https://urllib3.readthedocs.io/en/latest/v2-migration-guide.html>__ for help upgrading to the latest version of urllib3.

Removed

  • Removed support for Python 2.7, 3.5, and 3.6 (#&#8203;883 <https://github.com/urllib3/urllib3/issues/883>, #&#8203;2336 <https://github.com/urllib3/urllib3/issues/2336>).
  • Removed fallback on certificate commonName in match_hostname() function.
    This behavior was deprecated in May 2000 in RFC 2818. Instead only subjectAltName
    is used to verify the hostname by default. To enable verifying the hostname against
    commonName use SSLContext.hostname_checks_common_name = True (#&#8203;2113 <https://github.com/urllib3/urllib3/issues/2113>__).
  • Removed support for Python with an ssl module compiled with LibreSSL, CiscoSSL,
    wolfSSL, and all other OpenSSL alternatives. Python is moving to require OpenSSL with PEP 644 (#&#8203;2168 <https://github.com/urllib3/urllib3/issues/2168>__).
  • Removed support for OpenSSL versions earlier than 1.1.1 or that don't have SNI support.
    When an incompatible OpenSSL version is detected an ImportError is raised (#&#8203;2168 <https://github.com/urllib3/urllib3/issues/2168>__).
  • Removed the list of default ciphers for OpenSSL 1.1.1+ and SecureTransport as their own defaults are already secure (#&#8203;2082 <https://github.com/urllib3/urllib3/issues/2082>__).
  • Removed urllib3.contrib.appengine.AppEngineManager and support for Google App Engine Standard Environment (#&#8203;2044 <https://github.com/urllib3/urllib3/issues/2044>__).
  • Removed deprecated Retry options method_whitelist, DEFAULT_REDIRECT_HEADERS_BLACKLIST (#&#8203;2086 <https://github.com/urllib3/urllib3/issues/2086>__).
  • Removed urllib3.HTTPResponse.from_httplib (#&#8203;2648 <https://github.com/urllib3/urllib3/issues/2648>__).
  • Removed default value of None for the request_context parameter of urllib3.PoolManager.connection_from_pool_key. This change should have no effect on users as the default value of None was an invalid option and was never used (#&#8203;1897 <https://github.com/urllib3/urllib3/issues/1897>__).
  • Removed the urllib3.request module. urllib3.request.RequestMethods has been made a private API.
    This change was made to ensure that from urllib3 import request imported the top-level request()
    function instead of the urllib3.request module (#&#8203;2269 <https://github.com/urllib3/urllib3/issues/2269>__).
  • Removed support for SSLv3.0 from the urllib3.contrib.pyopenssl even when support is available from the compiled OpenSSL library (#&#8203;2233 <https://github.com/urllib3/urllib3/issues/2233>__).
  • Removed the deprecated urllib3.contrib.ntlmpool module (#&#8203;2339 <https://github.com/urllib3/urllib3/issues/2339>__).
  • Removed DEFAULT_CIPHERS, HAS_SNI, USE_DEFAULT_SSLCONTEXT_CIPHERS, from the private module urllib3.util.ssl_ (#&#8203;2168 <https://github.com/urllib3/urllib3/issues/2168>__).
  • Removed urllib3.exceptions.SNIMissingWarning (#&#8203;2168 <https://github.com/urllib3/urllib3/issues/2168>__).
  • Removed the _prepare_conn method from HTTPConnectionPool. Previously this was only used to call HTTPSConnection.set_cert() by HTTPSConnectionPool (#&#8203;1985 <https://github.com/urllib3/urllib3/issues/1985>__).
  • Removed tls_in_tls_required property from HTTPSConnection. This is now determined from the scheme parameter in HTTPConnection.set_tunnel() (#&#8203;1985 <https://github.com/urllib3/urllib3/issues/1985>__).
  • Removed the strict parameter/attribute from HTTPConnection, HTTPSConnection, HTTPConnectionPool, HTTPSConnectionPool, and HTTPResponse (#&#8203;2064 <https://github.com/urllib3/urllib3/issues/2064>__).

Deprecated

  • Deprecated HTTPResponse.getheaders() and HTTPResponse.getheader() which will be removed in urllib3 v2.1.0. Instead use HTTPResponse.headers and HTTPResponse.headers.get(name, default). (#&#8203;1543 <https://github.com/urllib3/urllib3/issues/1543>, #&#8203;2814 <https://github.com/urllib3/urllib3/issues/2814>).
  • Deprecated urllib3.contrib.pyopenssl module which will be removed in urllib3 v2.1.0 (#&#8203;2691 <https://github.com/urllib3/urllib3/issues/2691>__).
  • Deprecated urllib3.contrib.securetransport module which will be removed in urllib3 v2.1.0 (#&#8203;2692 <https://github.com/urllib3/urllib3/issues/2692>__).
  • Deprecated ssl_version option in favor of ssl_minimum_version. ssl_version will be removed in urllib3 v2.1.0 (#&#8203;2110 <https://github.com/urllib3/urllib3/issues/2110>__).
  • Deprecated the strict parameter of PoolManager.connection_from_context() as it's not longer needed in Python 3.x. It will be removed in urllib3 v2.1.0 (#&#8203;2267 <https://github.com/urllib3/urllib3/issues/2267>__)
  • Deprecated the NewConnectionError.pool attribute which will be removed in urllib3 v2.1.0 (#&#8203;2271 <https://github.com/urllib3/urllib3/issues/2271>__).
  • Deprecated format_header_param_html5 and format_header_param in favor of format_multipart_header_param (#&#8203;2257 <https://github.com/urllib3/urllib3/issues/2257>__).
  • Deprecated RequestField.header_formatter parameter which will be removed in urllib3 v2.1.0 (#&#8203;2257 <https://github.com/urllib3/urllib3/issues/2257>__).
  • Deprecated HTTPSConnection.set_cert() method. Instead pass parameters to the HTTPSConnection constructor (#&#8203;1985 <https://github.com/urllib3/urllib3/issues/1985>__).
  • Deprecated HTTPConnection.request_chunked() method which will be removed in urllib3 v2.1.0. Instead pass chunked=True to HTTPConnection.request() (#&#8203;1985 <https://github.com/urllib3/urllib3/issues/1985>__).

Added

  • Added top-level urllib3.request function which uses a preconfigured module-global PoolManager instance (#&#8203;2150 <https://github.com/urllib3/urllib3/issues/2150>__).
  • Added the json parameter to urllib3.request(), PoolManager.request(), and ConnectionPool.request() methods to send JSON bodies in requests. Using this parameter will set the header Content-Type: application/json if Content-Type isn't already defined.
    Added support for parsing JSON response bodies with HTTPResponse.json() method (#&#8203;2243 <https://github.com/urllib3/urllib3/issues/2243>__).
  • Added type hints to the urllib3 module (#&#8203;1897 <https://github.com/urllib3/urllib3/issues/1897>__).
  • Added ssl_minimum_version and ssl_maximum_version options which set
    SSLContext.minimum_version and SSLContext.maximum_version (#&#8203;2110 <https://github.com/urllib3/urllib3/issues/2110>__).
  • Added support for Zstandard (RFC 8878) when zstandard 1.18.0 or later is installed.
    Added the zstd extra which installs the zstandard package (#&#8203;1992 <https://github.com/urllib3/urllib3/issues/1992>__).
  • Added urllib3.response.BaseHTTPResponse class. All future response classes will be subclasses of BaseHTTPResponse (#&#8203;2083 <https://github.com/urllib3/urllib3/issues/2083>__).
  • Added FullPoolError which is raised when PoolManager(block=True) and a connection is returned to a full pool (#&#8203;2197 <https://github.com/urllib3/urllib3/issues/2197>__).
  • Added HTTPHeaderDict to the top-level urllib3 namespace (#&#8203;2216 <https://github.com/urllib3/urllib3/issues/2216>__).
  • Added support for configuring header merging behavior with HTTPHeaderDict
    When using a HTTPHeaderDict to provide headers for a request, by default duplicate
    header values will be repeated. But if combine=True is passed into a call to
    HTTPHeaderDict.add, then the added header value will be merged in with an existing
    value into a comma-separated list (X-My-Header: foo, bar) (#&#8203;2242 <https://github.com/urllib3/urllib3/issues/2242>__).
  • Added NameResolutionError exception when a DNS error occurs (#&#8203;2305 <https://github.com/urllib3/urllib3/issues/2305>__).
  • Added proxy_assert_hostname and proxy_assert_fingerprint kwargs to ProxyManager (#&#8203;2409 <https://github.com/urllib3/urllib3/issues/2409>__).
  • Added a configurable backoff_max parameter to the Retry class.
    If a custom backoff_max is provided to the Retry class, it
    will replace the Retry.DEFAULT_BACKOFF_MAX (#&#8203;2494 <https://github.com/urllib3/urllib3/issues/2494>__).
  • Added the authority property to the Url class as per RFC 3986 3.2. This property should be used in place of netloc for users who want to include the userinfo (auth) component of the URI (#&#8203;2520 <https://github.com/urllib3/urllib3/issues/2520>__).
  • Added the scheme parameter to HTTPConnection.set_tunnel to configure the scheme of the origin being tunnelled to (#&#8203;1985 <https://github.com/urllib3/urllib3/issues/1985>__).
  • Added the is_closed, is_connected and has_connected_to_proxy properties to HTTPConnection (#&#8203;1985 <https://github.com/urllib3/urllib3/issues/1985>__).
  • Added optional backoff_jitter parameter to Retry. (#&#8203;2952 <https://github.com/urllib3/urllib3/issues/2952>__)

Changed

  • Changed urllib3.response.HTTPResponse.read to respect the semantics of io.BufferedIOBase regardless of compression. Specifically, this method:

    • Only returns an empty bytes object to indicate EOF (that is, the response has been fully consumed).
    • Never returns more bytes than requested.
    • Can issue any number of system calls: zero, one or multiple.

    If you want each urllib3.response.HTTPResponse.read call to issue a single system call, you need to disable decompression by setting decode_content=False (#&#8203;2128 <https://github.com/urllib3/urllib3/issues/2128>__).

  • Changed urllib3.HTTPConnection.getresponse to return an instance of urllib3.HTTPResponse instead of http.client.HTTPResponse (#&#8203;2648 <https://github.com/urllib3/urllib3/issues/2648>__).

  • Changed ssl_version to instead set the corresponding SSLContext.minimum_version
    and SSLContext.maximum_version values. Regardless of ssl_version passed
    SSLContext objects are now constructed using ssl.PROTOCOL_TLS_CLIENT (#&#8203;2110 <https://github.com/urllib3/urllib3/issues/2110>__).

  • Changed default SSLContext.minimum_version to be TLSVersion.TLSv1_2 in line with Python 3.10 (#&#8203;2373 <https://github.com/urllib3/urllib3/issues/2373>__).

  • Changed ProxyError to wrap any connection error (timeout, TLS, DNS) that occurs when connecting to the proxy (#&#8203;2482 <https://github.com/urllib3/urllib3/pull/2482>__).

  • Changed urllib3.util.create_urllib3_context to not override the system cipher suites with
    a default value. The new default will be cipher suites configured by the operating system (#&#8203;2168 <https://github.com/urllib3/urllib3/issues/2168>__).

  • Changed multipart/form-data header parameter formatting matches the WHATWG HTML Standard as of 2021-06-10. Control characters in filenames are no longer percent encoded (#&#8203;2257 <https://github.com/urllib3/urllib3/issues/2257>__).

  • Changed the error raised when connecting via HTTPS when the ssl module isn't available from SSLError to ImportError (#&#8203;2589 <https://github.com/urllib3/urllib3/issues/2589>__).

  • Changed HTTPConnection.request() to always use lowercase chunk boundaries when sending requests with Transfer-Encoding: chunked (#&#8203;2515 <https://github.com/urllib3/urllib3/issues/2515>__).

  • Changed enforce_content_length default to True, preventing silent data loss when reading streamed responses (#&#8203;2514 <https://github.com/urllib3/urllib3/issues/2514>__).

  • Changed internal implementation of HTTPHeaderDict to use dict instead of collections.OrderedDict for better performance (#&#8203;2080 <https://github.com/urllib3/urllib3/issues/2080>__).

  • Changed the urllib3.contrib.pyopenssl module to wrap OpenSSL.SSL.Error with ssl.SSLError in PyOpenSSLContext.load_cert_chain (#&#8203;2628 <https://github.com/urllib3/urllib3/issues/2628>__).

  • Changed usage of the deprecated socket.error to OSError (#&#8203;2120 <https://github.com/urllib3/urllib3/issues/2120>__).

  • Changed all parameters in the HTTPConnection and HTTPSConnection constructors to be keyword-only except host and port (#&#8203;1985 <https://github.com/urllib3/urllib3/issues/1985>__).

  • Changed HTTPConnection.getresponse() to set the socket timeout from HTTPConnection.timeout value before reading
    data from the socket. This previously was done manually by the HTTPConnectionPool calling HTTPConnection.sock.settimeout(...) (#&#8203;1985 <https://github.com/urllib3/urllib3/issues/1985>__).

  • Changed the _proxy_host property to _tunnel_host in HTTPConnectionPool to more closely match how the property is used (value in HTTPConnection.set_tunnel()) (#&#8203;1985 <https://github.com/urllib3/urllib3/issues/1985>__).

  • Changed name of Retry.BACK0FF_MAX to be Retry.DEFAULT_BACKOFF_MAX.

  • Changed TLS handshakes to use SSLContext.check_hostname when possible (#&#8203;2452 <https://github.com/urllib3/urllib3/pull/2452>__).

  • Changed server_hostname to behave like other parameters only used by HTTPSConnectionPool (#&#8203;2537 <https://github.com/urllib3/urllib3/pull/2537>__).

  • Changed the default blocksize to 16KB to match OpenSSL's default read amounts (#&#8203;2348 <https://github.com/urllib3/urllib3/pull/2348>__).

  • Changed HTTPResponse.read() to raise an error when calling with decode_content=False after using decode_content=True to prevent data loss (#&#8203;2800 <https://github.com/urllib3/urllib3/issues/2800>__).

Fixed

  • Fixed thread-safety issue where accessing a PoolManager with many distinct origins would cause connection pools to be closed while requests are in progress (#&#8203;1252 <https://github.com/urllib3/urllib3/issues/1252>__).
  • Fixed an issue where an HTTPConnection instance would erroneously reuse the socket read timeout value from reading the previous response instead of a newly configured connect timeout.
    Instead now if HTTPConnection.timeout is updated before sending the next request the new timeout value will be used (#&#8203;2645 <https://github.com/urllib3/urllib3/issues/2645>__).
  • Fixed socket.error.errno when raised from pyOpenSSL's OpenSSL.SSL.SysCallError (#&#8203;2118 <https://github.com/urllib3/urllib3/issues/2118>__).
  • Fixed the default value of HTTPSConnection.socket_options to match HTTPConnection (#&#8203;2213 <https://github.com/urllib3/urllib3/issues/2213>__).
  • Fixed a bug where headers would be modified by the remove_headers_on_redirect feature (#&#8203;2272 <https://github.com/urllib3/urllib3/issues/2272>__).
  • Fixed a reference cycle bug in urllib3.util.connection.create_connection() (#&#8203;2277 <https://github.com/urllib3/urllib3/issues/2277>__).
  • Fixed a socket leak if HTTPConnection.connect() fails (#&#8203;2571 <https://github.com/urllib3/urllib3/pull/2571>__).
  • Fixed urllib3.contrib.pyopenssl.WrappedSocket and urllib3.contrib.securetransport.WrappedSocket close methods (#&#8203;2970 <https://github.com/urllib3/urllib3/issues/2970>__)

Configuration

📅 Schedule: Branch creation - At any time (no schedule defined), Automerge - At any time (no schedule defined).

🚦 Automerge: Disabled by config. Please merge this manually once you are satisfied.

Rebasing: Whenever PR becomes conflicted, or you tick the rebase/retry checkbox.

🔕 Ignore: Close this PR and you won't be reminded about this update again.


  • If you want to rebase/retry this PR, check this box

This PR has been generated by Mend Renovate. View repository job log here.

@renovate renovate bot assigned arska May 28, 2023
@codecov-commenter
Copy link

codecov-commenter commented May 28, 2023

Codecov Report

Merging #44 (3137225) into main (4ba2ffc) will not change coverage.
The diff coverage is n/a.

@@           Coverage Diff           @@
##             main      #44   +/-   ##
=======================================
  Coverage   98.71%   98.71%           
=======================================
  Files           3        3           
  Lines         312      312           
=======================================
  Hits          308      308           
  Misses          4        4           

@renovate renovate bot force-pushed the renovate/urllib3-2.x branch 2 times, most recently from ef4f35c to d34bf9c Compare October 2, 2023 21:09
@renovate renovate bot force-pushed the renovate/urllib3-2.x branch 2 times, most recently from 876e47c to 828ae60 Compare October 17, 2023 22:21
@arska arska merged commit 9452405 into main Dec 13, 2023
12 checks passed
@renovate renovate bot deleted the renovate/urllib3-2.x branch December 13, 2023 16:59
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

Successfully merging this pull request may close these issues.

2 participants